Minimax rate adaptive estimation over continuous hyper-parameters

نویسنده

  • Yuhong Yang
چکیده

|We study minimax-rate adaptive estimation for density classes indexed by continuous hyper-parameters. The classes are assumed to be partially ordered in terms of inclusion relationship. Under a mild condition on the minimax risks, we show that a minimax-rate adaptive estimator can be constructed for the classes. 1 Problem of interest This paper concerns adaptive density estimation. Information-theoretic tools will be used to derive minimax-rate adaptive estimators for density classes indexed by continuous parameters. observations with density f(x); x 2 X with respect to a-nite measure. Here the space X is general and could be any dimensional. The goal is to estimate the unknown density f based on the data. The Kullback-Leibler (K-L) divergence between two densities f and g is deened as D(f k g) = R f log (f=g) dd: Let k k denote the L 2 norm with respect to the measure ; i.e., kgk = q R g 2 (x)(dx). Both the K-L loss D(f k ^ f) and the squared L 2 loss kf ? b fk 2 for an estimator b f will be considered for density estimation in this paper.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Functional Linear Regression

Theoretical results in the functional linear regression literature have so far focused on minimax estimation where smoothness parameters are assumed to be known and the estimators typically depend on these smoothness parameters. In this paper we consider adaptive estimation in functional linear regression. The goal is to construct a single data-driven procedure that achieves optimality results ...

متن کامل

Mixing Strategies for Density Estimation

General results on adaptive density estimation are obtained with respect to any countable collection of estimation strategies under Kullback-Leibler and square L 2 losses. It is shown that without knowing which strategy works best for the underlying density, a single strategy can be constructed by mixing the proposed ones to be adaptive in terms of statistical risks. A consequence is that under...

متن کامل

Adaptive Functional Linear Regression via Functional Principal Component Analysis and Block Thresholding∗

Theoretical results in the functional linear regression literature have so far focused on minimax estimation where smoothness parameters are assumed to be known and the estimators typically depend on these smoothness parameters. In this paper we consider adaptive estimation in functional linear regression. The goal is to construct a single data-driven procedure that achieves optimality results ...

متن کامل

Estimating Sparse Precision Matrix: Optimal Rates of Convergence and Adaptive Estimation

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of convergence are established for a range of matrix norm losses. A fully data driven estimator based on adaptive constrained `1 minimization is proposed and its rate o...

متن کامل

Sparse PCA: Optimal Rates and Adaptive Estimation

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional setting. Under mild technical conditions, we first establish the optimal rates of convergence for estimating the principal subspace which are sharp with respect to...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 47  شماره 

صفحات  -

تاریخ انتشار 2001